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ABSTRACT 

This paper presents finite dimensional approximations for linear retarded 
functional differential equations by use of discontinuous piecewise linear 
functions. The approximation scheme is applied to optimal control problems, 
when a quadratic cost integral has to be minimized subject to the controlled 
retarded system. It is shown that the approximate optimal feedback operators 
converge to the true ones both in case the cost integral ranges over a finite 
time interval as well as in the case it ranges over an infinite time inter- 
val. The arguments in the latter case rely on the fact that the piecewise 
linear approximations to stable systems are stable in a uniform sense. This 
feature is established using a vector-component stability criterion in the 
state space if x L 2 and the favorable eigenvalue behavior of the piecewise 
linear approximations. 


This research was supported in part by the National Aeronautics and Space 
Administration under NASA Contracts No. NAS1-17070 and NAS1-18107 while the 
author was in residence at ICASE, NASA Langley Research Center, Hampton, VA 
23665 and in part by the Fonds zur Foerderung der wissenschaf tlichen Forschung 
(Austria) under Grant No. 53206 while in residence at the Universitaet Graz, 
Graz, Austria in connection with his Ph.D. Thesis. 


i 


i. INTRODUCTION 

Given <j>^e IRP and <J> ^ : [-h,0]+ itf 1 consider the retarded functional 

differential equation with constant coefficients 

. p 0 

x(t) = l A, x(t-h ) + / A n (s)x(t+s)ds, t > 0 

k=0 k K -h U1 “ 

x(0) = <|)^, x = 4> ^ in L^(-h,0; itf 1 ). 

An equivalent abstract Cauchy problem z(t) = Az(t), t >_ 0; z(0) = 

in the space M ^ = K 1 x l/(-h,0; if 1 ) generates a strongly continuous 

semigroup. Approximations are constructed by restricting the problem to 

finite dimensional subspaces Z N = if 1 x C defining appropriate 

N N 

generators A on Z . 

Banks and Burns [1] used subspaces Y N which consist of functions that 

are piecewise constant on the delay interval [-h,0]. This is the well-known 

averaging approximation scheme. As an extension. Burns and Cliff [5] enlarged 
the subspaces to piecewise linear functions. In both papers, the approximat- 
ing generators were constructed by forward difference methods. In [3] the 
approximations were obtained by projections onto subspaces of continuous 
splines being contained in the domain of A. Then Kappel and Salamon [14] 
introduced 5-type operators in order to define generators for a spline scheme 
whose adjoint semigroups converge strongly. These 6-type operators are 
specially constructed to approximate the differential operator A at the 

discrete delays, where the splines may be discontinuous, as are the functions 

* 

in the domain of A . 
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In this paper, a new scheme is presented employing again subspaces of 
orthogonal piecewise linear functions as in [5], but using 6-type operators 
for the construction of the approximating generators. These operators are 
needed at each meshpoint, where the subspace functions may be discontinuous. 
In fact, the number of discontinuities increases with the order of the approx- 
imation, in contrast to the spline case. The resulting generators are 
completely different from those given in [5]. 

An application of the approximation schemes is the optimal control prob- 
lem, when an integral ranging over [0,T), quadratic in the trajectory and in 
the control, is to be minimized subject to the controlled delay equation. It 
was shown by J. S. Gibson [9] that, if T < ", the strong convergence of 
the semigroups and their adjoints yields convergence in norm of the optimal 
feedback operators. In this present work, strong convergence of the 
semigroups and their adjoints is proved using the Trotter-Kato Theorem as in 
[1], [9] # Thereby, it is not necessary to assume absolute continuity of Aq^, 
as did the proofs in [12], [13], [14]. 

In the case of the so-called infinite time horizon T = ", Gibson^s 
approach relies on the assumption that a stable system is approximated by 
systems that are stable in a uniform sense. For the averaging scheme, this 
stability preservation property was established in [19], and in [12] for the 
Legendre-tau methods. In contrast, the spline schemes do not have this qual- 
ity (see [14]). This is due to extraneous eigenvalues close to the imaginary 
axis. It is shown below that the eigenvalues of the present scheme converge 
to those of the delay equation and that exponential stabilty of our approxima- 
tions is dominated by their l^-components. Thus, uniform preservation of 
exponential stability is proved with decay rates arbitrarily close to the 
decay rate of the hereditary system. 
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The matrices corresponding to the piecewise linear functions are banded 
and sparse, in contrast to the Legendre and spline methods. While the 
Legendre schemes [11], [13] exhibit high accuracy even for low order of 
approximation, the numerical efficiency of the present scheme is about the 
same as that of the first order splines in [14], and superior to the averaging 
methods [1] as well as those in [5]. 

Preliminarily, Section 2 collects some facts on the semigroup generated 
by the uncontrolled system and on the linear quadratic hereditary control 
problem (see [6], [8], [9]). Section 3 presents an approximation framework 
suited to Chapter 4, where the piecewise linear scheme is developed. In Sec- 
tion 4.1, the 6-type operators are defined and the projections onto the sub- 
spaces of piecewise linear functions are investigated. In Section 4.2, the 
approximating generators and their adjoints are constructed and convergence 
results for the finite time horizon problem are proved. In 4.3, the matrix 
representations are given and an H^-component stability criterion is 
established. Section 4.4 investigates the eigenvalue behavior of the approxi- 
mate systems when the order of approximation increases. In Section 4.5, the 
uniform stability preservation is proved. Finally, in 4.6 there is a brief 
discussion of the numerical tools needed for the implementation of the scheme 
on a computer and the results of three examples are tabulated. 


2. THE LINEAR QUADRATIC OPTIMAL CONTROL PROBLEM FOR HEREDITARY SYSTEMS 

We are concerned with the linear retarded functional differential 
equation 


i 
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(2.1;1) x(t) = Lx fc + Bqu( t ) , t > 0 

in II? 1 , where for some fixed finite delay h > 0, x^: [-h,0]-»- IFP is defined 
by x t (s) = x(t+s), Bq is a real nxm-matrix and u(t) e H?". The bounded 

linear functional L: C(-h,0; I? 1 ) -»■ I? 1 is given by 

i P • ^ t 

L<|> 1 = l A, 4> (“b.) + / A (s)<(. (s)ds, 

k=0 -h 

with 0 = < hp = h, e H?* Xn , k = (),•••, p and A^ e L 2 (-h,0; 

lP Xn ). 

Given <(, = (-j. 0 ,^ 1 ) e M 2 = If 1 x L 2 (-h,0; if) and u e I^ oc (0,“>; H?") , 
there exists a unique solution x(t;$,u), which is absolutely continuous 
with L 2 -derivative on every interval [0,T], and satisfies (2,1;1) for almost 
all t ^ 0, and the initial condition 

(2,1;2) x(0;<J>,u) = <J>° , x(*;<j>,u) = 4) 1 in L 2 (-h,0; I? 1 ). 

Defining the state at time t by 

(2.2) z(t;<J>,u) = (x(t;<J>,u), x t (<)>,u)) e M 2 , 

o 

system (2.1) is converted to an abstract Cauchy problem in M , which is a 
Hilbert space with the inner product <(<|>^, ('J^,f*)> = + <<t>^,<|^> 2 » 

Let S(t), t _> 0 be the Cg-semi group corresponding to the free motion of 
(2.1), i.e., 

t > 0, ij> e M 2 


S( t )<|) = (x(t;<)>,0), x t (<J>,0)), 


__ o 

and define the input operator B:1R > M by 

Bu = (BqU, 0) , u e if 1 . 

Then the evolution of z(t;<J>,u) in time is governed by the variation of 
constants formula 

t 

(2.3) z(t;<|>,u) = S(t)«j> + / S(t-s)Bu(s)ds, t > 0, 

0 

The infinitesimal generator A of S(») is given by 

dom A - {<t> e M 2 | <|> 1 e W 1 ,2 (-h,0; #) , ^(O) = 4> 0 } , 

A<J) = (L* 1 ,* 1 ), 

where >P(a,b; H?) denotes the space of I^-valued absolutely continuous 

functions on [a,b] possessing j-1 continuous derivatives and j-th deriva- 
tives that are in L^(a,b; itf 1 ). The function z(t; <J>,u) in (2.3) is a 
mild solution of the abstract system 

(£) z(t) = Az(t) + Bu(t), t 0, z(0) » 4> . 

Weighting the past history by the step function 


g(s) = p - k + 1, 


s e 




,P, 
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we have an equivalent norm corresponding to the inner product 


OT o ^ 1 T 1 2 

* <|) ^ + / <t> (s) (s)g(s)ds, (|), 1 |) e M . 


-h 


If 


(2.4) 


“>f + 'V + T J. |A k! 2+ " A 01» t 2. hn ^ 

k=l L (-h,0; K 1 n ) 


the operator A-u>I is dissipative in M , that is 


<AcJ> ,4>> <! wll4>ll , <(> e dom A. 

O S 


Therefore, by the Lumer-Phillips Theorem, there exists a constant M 
that 


(2.5) 


I S ( t ) It < Me° )t , t > 0. 

M 


*7 o . 

The M^-adjoint of A generates the M -adjoint semigroup S(t) , t 

given by 


dom A* = {<(. e M 2 )^ 1 + AJ<J.°x r . . e W 1,2 (-h,0; Iff 1 ), ^(-h) 

k=l 1 ’ k' 

(A%)° = ^(0) + aJ|> 0 , 


( A*4> ) 


1 



> I such 


0 and is 
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X^. denotes the characteristic function of the interval I. The optimal con- 

2 

trol problem on a finite interval is: given 0 < T < «® and <j> e M find 
the control u e L (0,T; IR") that minimizes the cost functional 


J(u,<J> ,T) = x(T;i{>,u) T G x(T;<() ,u) + / (x(t;<f>,u) T W_x(t;<J>,u) + u(t) T Ru(t))dt, 

u o u 

T T T 

where Gq = Gq and Wq = Wq are nonnegative matrices and R = R is 

2 2 0 

positive definite. Defining the operators G: M -*• M by G<|> = (Gq<}> 

and W: by W<J> = (Wq<|>^,0) we have 


J(u,(j) ,T) = <z(T;<(),u), Gz(T;<(i ,u)> + 


( 2 . 6 ) 


+ / (<z(t;(|> ,u) , Wz(t;<j>,u)> + u(t) Ru(t))dt. 

0 


The solution to the linear quadratic control problem (2.3), (2.6) in the 

Hilbert space is based on the Riccati differential equation 


<ip ,n(t )<f»> + <At|>,n(t)<j>> + <n(t)i{-, a<()> - 


(2.7) - <n(t)i|>, BR 1 B*n(t)<|>> + < 1 |),W«|)> = 0, for <\> , e dom A, 0 _< t _< T, 


n(T) = G. 


There exists a unique, strongly continuous family of nonnegative self adjoint 
operators H(t), t > 0, satisfying (2.7). The optimal control uT is 


given in feedback form 
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( 2 . 8 ) 


u(t) = -R 1 B*n(t)z(t), 0 < t < T, 


where z(t) is the mild solution of 


z(t) = (A - 


BR 1 B*n(t) ) , 


z(0) = <|), 


i *6 • ) 


u —1 * 

z(t) = s(t)<|) - / S(t— s)BR B n(s)z(s)ds. 

0 

The optimal cost is J(u,<|>,T) = <<f> ,n(0)<|>>. With respect to the product 
structure of M 2 , we can write 


H(t) = 


n oo^ n oi^ 


n io (t) n n (t) 


0 < t < T. 


n Q0 (t): -► IFf 1 and n n (t): L 2 (-h,0;lT) * L 2 (-h,0; I? 1 ) are selfadjoint 

and nonnegative. Since Il^Ct): Tl? 1 •* L 2 (-h,0; if 1 ) , it has a representation 

n 

by a matrix valued function Il^Ct,*) e L (-h,0; if 1 * 11 ), i.e., 

(ni 0 (t)O( s ) = n jQ(t,s)C, 0 < t < T, 5 e if 1 . Using this notation, we write 
for <f> 1 e L 2 (-h,0; IFf 1 ) 

n* 0 (tH l = n 01 (t)4» l = / n]’ 0 (t,s)<|, 1 (s)ds. 

-h 

* TO 2 

Since B <j> = B^(j> , $ e M , the feedback law can be written in terms of the 


delay system: 
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U(t) = -r 1 Bj[n 00 (t)x(t) + / n[ 0 (t,s)x(t+s)ds], 

-h 

x(t) being the solution of the closed loop system 

x(t) = (A q - B 0 R" 1 Bjn 00 (t))x(t) + l A k x (t " h k ) + 

k=l 

+ / ( Aq j ( s ) - BqR l BQlIj 0 (t,s))x(t+s)ds, 0 < t < T. 

— h 

We also consider the infinite time horizon problem, that is the minimization 

of J(u,<}>) given by (2,6) with G = 0 and T = «, and assume that the 

system (2,1 ;1) is stabilizable, i.e., A - BK generates an exponentially 

2 

stable semigroup for some linear bounded operator K: M if 1 . Then there 

2 

exists a nonnegative, selfadjoint operator II e L(M ) that maps dom A 
into dom A and satisfies the algebraic Riccati equation 

it -1 A 

(2.9) A n<f> - IIA4> - HBR B n<f> + W<t> = 0, <f> e dom A. 

If, in addition, system (2,1; 1) and Wq have the property, that any 

admissible control drives the state to zero, that is J(u,$) < « implies 
z(t;<|>,u) 0, as t + », then II is uniquely determined. This certainly 

is true if (2 , 1 ; 1 ) with output Wq is observable or if Wq is simply non- 

singular, Using the time independent solution of (2.9) in the feedback law 
(2.8) gives the optimal control and trajectory as in the finite time horizon 


case. 
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3. FINITE DIMENSIONAL APPROXIMATIONS 

Our goal Is to construct systems of ordinary differential equations, such 

that their solutions approximate the solution to the hereditary control prob- 

N 

lem in Section 2, To this end, let Y , N=l,2,»»» be a sequence of fl- 

2 

nlte dimensional subspaces of L (-h,0; 1?) with corresponding orthogonal 

projections p^. Then Z N » if 1 x Y N , N « 1,2,»»» are finite dimensional 

2 N 0 N 1 

subspaces of M with corresponding orthogonal projections p <j> = (<J> , p ^ 4> )» 

2 N N N 

<t> e M , Suppose there is a sequence of linear operators A : Z -*• Z and 

N o 

let S (t), t^ 0 be the uniformly continuous semigroups on generated 

by the bounded linear operators A^p N : z^ 1 , i.e., 

e N, ^ A N p N t. . „2 

S = e <j>, <\> e M • 

Remark , We extend to all of because we want the semigroup 

acting on the whole space. Instead of letting the generator A N p N =0 on 

(Z N )\ we equally well could choose another appropriate extension. All that 

is said about the control problems in and the corresponding semigroups 

N o 

S (•) in in this section, remains valid, if we take the generator of 

SV) to be A N p N - a(I - p N ) with some a e R For simplicity of 
exposition, we shall make use of this possibility only at the end of the proof 
of Theorem 3.5 below. 

We will use the following hypotheses in order to get the desired conver- 
gence of S N (t) to S(t), the solution of semigroup generated by A as 


defined in Section 2 
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(Hl) There exists a constant u> e 1R such that 

<aV*> < oj II <(> II 2 for all <(> e Z N , N « 1,2,*** . 

8 S 

(H2) There exists a subset D C don A and a real number X > u), such that 

(i) (XI - A)D is dense in M 2 , 

(ii) for all 4» e D » A N p N <(> -*■ A<fi as N -*■ ». 

By the Lumer-Phillips theorem, (HI) implies 

(3.1) II S N ( t)4> II < Me Ut ll<j>ll , t > 0 

M M L 

2 -12 
for all <J> e M and some M > 1. Since (XI - A) : M dom A is con- 

o 

tinuous if X > oj, (H2) (i) implies that also D is dense in M , so that 
we have the following version of the Trotter-Kato theorem [17, III. Th. 4.5]. 

Theorem 3.1: If the sequences Z^, A^, N =» 1,2, ••• satisfy (HI) and 

(H2), then for all (|> e M^, S N (t)<f> -*■ S(t)4>,N «, uniformly in t on 

bounded intervals. 


Observing B5 = (Bq 5,0) e Z N , 5 e H? 1 for all N, we take the input 
operators B^: I? -»■ Z N as B N £ = BS to define finite dimensional 
control systems on Z 1 *: 


(£ N ) z(t) = A N z(t) + B N u(t), t > 0, z(0) = p N <fr, 
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7 0 M 

where u(») e L^ oc (0,“; an< i ^ e ™ • T ^ ie so ^ ut i° n to (I ) is 

given by 

z N (t;p N <() ,u) = S N (t)p N * + / S N (t-s)B^u(s)ds. 

0 

As a consequence of Theorem 3.1, one derives (see for instance [14], Th. 4.2) 
convergence of z N (t ; p N cj> ,u) to z( t ; cj> , u) , the solution of (£) given in 

(2.3): 


Corollary 3.2. Assume (HI), (H2) and 


(H3) 


N. 
P 4> 


for all <J> e M 


Then for all 


4> e M 


2 


(3.2) z N (t;p N <)>,u) -*■ z(t;4>,u), _as N ». 

The limit is uniform in t on bounded intervals and u in bounded subsets 

of l 2 i oc ( 0,»; l? 1 ). 

Writing z N (t;p N <j> ,u) = (x^(t) ,y^(t) ) e z\ with some x N (t) e T^ 1 , 
y^(t) e Y N (3.2) implies x N (t) * x(t;<(»,u) uniformly in t on bounded 
intervals, where x(t;<J>,u) is the solution of the hereditary system (2.1). 

Seeking approximations for the optimal control problem (2.3), (2.6), we 
define the costs J (u,<J>,T) by 
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(3.3) 


M , N N M N 

J (u,<f> ,T) = <z (T; p W <j> ,u) ,Gz (T;p <j>,u)> 


+ / (<z N (t;p N <|),u) ,Wz N (t;p N <J),u)> + u(t) T Ru( t))dt. 

0 

From the control theory of finite dimensional systems, it is well known that 
the optimal control minimizing (3.3) is given by 


(3.4) 


At) 


-R _ 1 (B N )V(t)At), 


0 < t < T 


where 


-N,.* 
z (t) 


is the solution of 


At) 


(A N - B N R _1 (B N )V(t))z N (t), z N (0) = p N <fr, 


N N N 

and H (t): Z + Z Is the unique nonuegative selfadjoint solution of the 
Riccati differential equation on Z^ 


d . , ,.N * N- . ^ N, N .N 

n (t) + (a ) n (t) + n (t)A 


(3.5) 


-nV^R-'CBVlAt) + W N - 0, 0 < t < T, 


ir N (« - c N . 


N N N 

Here G <J> * G<}> and W $ = W4> for <|> t Z . The optimal costs are given 
by J (u ,<\> ,T) = <p <(),n (0)p <f> > . 

In applications, the original system (£) is controlled by use of the 
approximate feedback law (3.4) instead of (2.8), i.e., H(t) is replaced by 



the so-called suboptlmal control 


(3.6) 


u N (t) = -R 1 (B N )*I N (t)p N z N (t), 0 < t < T, 


where z N (t) 


Is the mild solution of 


z(t) = (A - BR 1 ( B N ) II N (t)p N )z(t), z(0) = 4> . 


In order to establish convergence of the optimal and suboptlmal controls, we 
have to deal with the M^-ad joint semigroups S^(«)* generated by the M^- 
adjoints (A N p^)* of A^p N . The adjoint of A N : + Z^ is 


(A N )*: Z N ♦ Z N . 


Therefore, <A N pV - (p N A N p N )‘ - p 8 (A B )*p N - (aVp". 


Since (HI) implies (3.1), the estimate (3.1) is valid also for (A* 1 )* if 
A n , N = 1 ,2 , • • • satisfy (HI). Thus, using Theorem 3.1 and Corollary 3.2, 

beside (HI), (H3) we need (H2) with A, A^ replaced by A*, (A^)* respec- 
tively (this will be denoted by (H2*)), to obtain S N (t)% -*■ S*( t )4> , <|> e M 2 , 
uniformly in t on bounded intervals. 

The following assertions were proved in [9] (also [14], Th. 4.3). 


Theorem 3.3: Let (HI) - (H3) and (H2*) hold. Then, as N -*■ » 

(a) lin N (t)p N - n ( t ) II -► 0. 

L(M ; 

(b) For the controls and trajectories given in (3.4), (3.6), and (2.8) 
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the limits being uniform in t, 0 _< t _< T. 

(c) ♦ J(u,*,T), J N (TT N ,<J> ,T) ♦ J(u,<fr,T). 

In the case of the infinite time horizon, we deal with the algebraic 
Riccati equations 

(3.7) (A N )*n N + n N A N - n N B N R -1 (B N )*n N + w N = o 

on Z N , N = 1,2,««» , If (A N ,B N ) is stabilizable, then there exists a 

nonnegative, selfadjoint solution of (3.7), governing the optimal feed- 

back. 

N 

We will establish convergence of the Riccati operators II again using 
Gibson's arguments [9], However, this approach is based on the assumption 

that the stabilizability of the hereditary system implies that the systems 
(A^,B^) are stabilizable in a uniform sense with respect to N (see hypoth- 
esis (H5) below). As to the investigation of stabilizability or exponential 
stability of Cg-semigroups there is a L^-stability criterion due to R. Datko 
[7], We state here a special version (a proof may also be found in [19]). 

Lemma 3*4: Let S(t), t _> 0 be a C^ -semigroup of bounded linear 

operators in a Banach space X satisfying 

a,t 

(3.8) fl S( t )II L ( X ) £ l^e , t>0 and 

"2 2 
/ IS(t)xl*dt < c.llxll , x e X 

rv X — IX 


(3.9) 
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for some constants M L , ctj, c l > 0. Then there exists an exponent 
a = a(Cj,Mj,aj) > 0 and a constant M = M(Cj,Mj ,O j) > 0 such that 

(3.10) "S(t)ll L ( X ) £ Me _0tt , t >_ 0. 

N 

Note that if we can prove (3.9) for the semigroups S (•) with cj 
independent on N, then, by (HI), (3.10) yields the exponential stability of 
S N (») uniformly with respect to N. Moreover, observe that the estimate 
(3.9) is eqivalent to 

(3.11) / | (S(t)x)°| 2 dt £ c.llxll 2 , x e M 2 , 

0 JR M 

2 

for some constant C 2 > 0, if S(») is the solution semigroup on M as 
defined in Section 2. By Fubini's theorem, this equivalence follows directly 
from the state concept (2.2) and is a special feature of the semigroup 
associated with the retarded functional differential equation (2.1 ;1). 

As far as we want the semigroups S (•) to be suitable approximations 
for S(«), it seems to be natural to demand the equivalence of (3.9) and 

(3.11) also with regard to S N (»). We call this the VDP-property of the 

approximations (meaning the vector-component dominance is preserved). It 
plays an important role for our approach to stability questions in context 
with the infinite time horizon control problem. 

N 

Suppose for N sufficiently large there exists a solution II to the 
Nth algebraic Riccati equation (3.7). Then with 


a** - a n - 


„N -1,„N * N 
B R (B ) II 
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— N N — N 2 

A p generates an exponentially stable semigroup S (•) on M . We 

introduce the projection V: ■* 

v^ 0 ,* 1 ) = <f>° 

and want the following hypothesis to be valid: 

(H4) Provided N is sufficiently large, there exists a _> 0, independ- 

N 

ent on N, such that for all <j> e Z 

00 

/ iS^Ct)*! 2 , dt < c. 114.11 2 

0 n 1 n 

if and only if there exists a >_ 0, independent on N, such that 

for all 4> e 

00 

/ I VS^Ct )<t> ! 2 dt < c, ll<f>n 2 , . 

0 if M 

If n is a nonnegative selfadjoint solution to the algebraic Riccati 

equation (2.9) for the hereditary control problem, define the operators 
~N N N 

A : Z 1N -*• Z , N * 1 , 2 , • • • by 


rN 


.N 



* 

b n 


and let S^(*) be the uniformly continuous semigroup on generated by 

~N N 

~N N . ~N, v Apt _ N 

A p , i.e., S (t) = e K , t _> 0. 


Intending to provide the existence and uniform boundedness of the oper- 
ators II N , we demand: 
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(H5) If the hereditary system (E) Is stabillzable, then there exist con- 
stants M, 8 > 0 such that for N sufficiently large 


~N 

ns N (t) 


< Me 


-at 


t > o. 


Theorem 3.5: Let (HI) - (H5), (H2*) hold and assume W Q _is_ 

nonsingular » If the hereditary system is stabilizable, then 

(a) for N sufficiently large there exists a solution H N to the Nth 
algebraic Riccati equation (3,7) and 

ii n N p N - nn 0 -*■ o, n 

L(M ; 

(b) The optimal and suhoptimal controls and trajectories and the correspond- 
ing costs converge as in Theorem 3.3 (b), (c). 

Proof : As in [9, Th. 7.4], we first consider the Nth problem (E^) 

with initial value <j> e M , when it is controlled by the feedback 
u N (t) = -R~^B*IIp N z(t). The evolution of the state in time is then described 

by z^(t) = '§^(t)p^ij) and the corresponding costs can be estimated using 

(H5): 

J (u ,<f>) = / (<z (t),Wz (t)> + u (t) Ru (t))dt 
0 

< (|w 0 | + Ir" 1 ! I b q | 2 ii n ii 2 > nn 2 . 
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N 

Thus, there exists a nonnegative self adjoint solution II of the Nth alge 
braic Riccati equation for N sufficiently large and 


✓ N ,. tt N N xn / T N /~ N x \ / ...2 

<p <f> »n p 4>> <_ J (u ,<{>) £ n ()> n 


with some constant c^, which does not depend on N. Therefore, there is an 
index Nq such that 

(3.12) nn N p N ll £ Cj, N > Nq. 

The convergence statement in (a) now follows from [9, Th. 6.9], once that we 
have shown 

(3.13) nS N (t)ll <He" at , t > 0, N > N Q 
for some constants M, a > 0. 

Since Wq > 0 we have | C | 2 £p _1 S T Wq 5, 5 e if 1 , where y is the minimum 
eigenvalue of W Q . Following the arguments given in [9] (proof of Th. 7.5) 

let 4> G and define "i^(t) = S^(tH = (x^(t) , y N (t)) with x^(t) e 

if 1 , y N (t) e Y^, t y_ 0. Further note that <R n^z^(t),B n z (t)> £ 0, 

N/ \ u I? 1 

y N (t) so that 


/ |x N (t)| 2 dt < y" 1 / x N (t) T W x N (t) dt 
0 “0 

< y _1 / <7 N (t),(W + n N BR~ 1 B*n N )z N (t)> „dt 

0 M* 
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- u" 1 <<t> » / (sV(t)(w + n N BR~ 1 B*n N )s N (t)<(.dt> = u ! <4>,n N 4»>, 

o 

00 

applying [9], Cor. 4.2 to the semigroups S^(»). It follows f |vlf N (t)<j>| 

0 

oo 

dt < p _1 c ll<j>ll 2 , N > N and, by hypothesis (H4), / IIS^tHlI 2 dt £ #d) II 2 

- 1 u Q l 

m -1 * N> N 

with some > 0. Also, because S is generated by (A - BR B H )p , 

(3.1) and (3.12) imply (e.g. [17], III. Th. 1.1) the existence of constants 

— N a l t 

Mj , a^ such that Ills (t)lt <_ M^e , t > 0, N > Nq. Now Lemma 3.4 assures 
that there are constants M, a > 0 such that 


IIS N (t) 


-at 


II < Me t > 0, N > N , 

N — — — u 


But this proves (3.13), since, as we mentioned in the remark above, we may re- 


place A^p^ by 


A N p N - a(I-p^), so that 


ns N (t) 


finite dimensional control problems on Z N remain completely unchanged. 
Statement (b) follows from (a) in a manner similar to that in the finite time 
horizon case (see [9] or [14]). 


( z ") 1 


< e 


-at 


while the 


4. THE PIECEWISE LINEAR APPROXIMATION SCHEME 

While the foregoing statements are of rather general nature, this section 
presents a special approximation scheme using so-called piecewise linear func- 
tions. We prove via several lemmas that this scheme satisfies the hypotheses 
(HI) - (H3) and (H2*). Then we show that it has the VDP-property , so that 
(H4) is valid. Furthermore, we investigate the characteristic matrix of the 
approximate systems in order to establish results on the eigenvalue behavior 
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when the approximation index increases. This enables us to conclude (H5). 
Finally, we present some of our numerical findings. 


4.1 Projection onto spaces of piecewise linear functions 

m 

Corresponding to the discrete delays h^ in (2.1;1), for N = 

we subdivide the intervals I k = [ -h^ , -h^- ^ ) , k = 2,»*»,p and Ij « [-hj,0] 

into the subintervals 1^. = [t^. ,t!^ . .), k = j = (with 

^ 3 k , j - 1 

the exception 1^ = [t^,0]) by defining the meshpoints 

- -Vi -J r k /N ' i 


where 


r k ~ ^k— 1 » ^ 1 9 ' 


,P. 


For each N e IN the set Y^ of all 


functions [ — h , 0 ] + TFf 1 that are polynomials of degree one on every interval 

1^. is commonly called a space of piecewise linear functions on [-h,0]. A 
basis of Y n is given, written in a simplifHed notation, by the 2pN matrix 


functions 


(4.1) 


N 


k,2j-l (s) x N (s) * T ’ 

kj 


k - 1, ‘".P, j = 1 » • • • »N 


N 


,2N 


k,2j (s) = ( rT (s+h k-l )+2J “ 1)x T N (S) * T ’ 

kj 


where I denotes the nxn identity matrix. The following diagram illus- 
trates the definition of the basis elements. 
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<■* ^TM M 

The pairs = (1,0) and = (0,e^. ) are a orthogonal basis of the 

n(2pN+l) dimensional product space Z N = Ef 1 x Y N , N = 1,2, ••• , The 

orthogonal projections p N : M 2 Z N are of the form d N (4>°,4» - 1 ) = 

(^,P^ <t>h, where p!j* is the L^-orthogonal projections from onto 

Y N . With 


(4.2) 


N ■'N “M 

« ■ ■ 


diag ^ 1 ’Tr ’ 3ST ’ * • • » JT* Iff* TT* 3F» •••» IT* Itf) ® 1 


we have 


(4.3) 


<♦»♦> = a N (<J>) T Q N a N (i(;) , (j>, ip e Z N , 


(4.4) 


N/ N, 


«"(p"+) = (Q N ) 1 col(«))^,<e^ 1 ,4> 1 >2» »< e p 2N ,< * ,1> 2^’ ^ e M 


N , 1, 


where the components of the coefficient vector a^(p^<j>) are given by 
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= 4> and 


(^•5) d k = 1 , • • • , p , j=l,»»»,N. 

N , N n . 3N , N , x 1, NJ 
a k,2j (p ^ r R e k,2j (s ^ (s)ds * 


We frequently will use the abbreviations = ct!*,(p N <|>) and <Ji N = p^ 1 

kj Kj 1 

Note that 


(4.6) 


.N - N 1/2 1 

k,2j-l ' i ( 7^ ) * + “2 


l^ 2j l <& U2 '♦ 1 «2 • 


k = 1 » • • • »P» j = 1 » • • • »N 


Obviously, the spaces are not contained in the domain of the gene- 

rator A of the hereditary semigroup, since the elements of Y N are not dif- 
ferentiable on [-h,0] . Nevertheless, the action of A and A* can be 

approximated by operators on Z N imitating, heuristically speaking, the delta 
distributions in the derivatives of discontinuous functions by operators 6^ 
in Y N . Following the ideas developed in [14], we need the operators 6^ 
for each point, where the piecewise linear functions in Y^ may have jumps. 

We define if 1 -► Y N , N = 1,2, ••• by 


5 


N- 

kj 


(O 


f N_ N 3N N 

\ C k,2j+1 r k e k,2j+2 


k - 1, J - 0, • • • ,N-1 
k = 2, • •• ,p, j = 1 , • • • ,N-1 


6 


N- 


kN 


U) = (• 


_N 

r k+l 


N 

®k+ 1 , 1 


3N N 
r k+l 6k+1 ’ 2 


)5> k = !,••• ,p-l 
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.N+ ,N N 3N N . 

5 kj (5) = e k,2j-l "7^ e k,2j H> k=l,...,p, j =!,•••, N. 


Proposition 4.1. (a) For any 5 e if 1 and (j) 1 e L 2 (-h,0; I? 1 ) 


(4.7) 


k = 1, i = 0,*»»,N 

<<:CO,^> 2 = C T <l> N (t"~), k = 2, • • • ,p-l , j = 1 , • • • ,N 

k - p» .1 = 1 > • • • ,N— 1 


(4.8) 


< ' 6 ^(5), ( l )1 >2 - 5 T 4> N (t^)» k = 1 , • • • ,p, j = !,••••, N, 


In (4.7) and throughout the paper, we use the notation 4> N (t^7) for the 

left side limit of 4>^ at t^.. 

kj 


(b) The norms of the 6-operators are 


N- N 1/2 k 3 0,»»»,N— 1 

» 6 " » = 2 (^-) 1/2 , 

k k = 2,»»»,p, j = 1 , • • • ,N— 1 


ll6 kN" = 2 ^r“ ) 1/2 » k = l,...,p-l 

N r k+l 


" 6 kj" = 2 (|-) 1/2 . k = l,...,p, j = 
lc 


Proof : (a) Let 1 k p and 1 <_ j N-l. Using (4.5) and observ- 


ing that 


N N- _ N , N- x 

k,2j-l (t k,j-l ) 


we get 
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<*5«>A ■ i *;.u« + f ^ >2J+ 2 )(s, *‘< s)ds 


o 


.T,N_ N 
-h r k 


3N N 
r k 


r T-,N . .N . _T N. N-, 

5 (<t> k,2j+l <t> k > 2j+2 ) 5 * fc kj ^ * 


N- 


The proof for k = l,»»«,p-l, j = N and for 6^ is analogous. The 


statement on follows similarly from the fact that e£ 2j-l^ t kj^ * 1 


N / fc N 


kj 

and e^ ^(t^) = -I, k = p, j = N. 


(b) Since the basis of Y N is an orthogonal set, we have 


<<«»2 = ^ 77 )2 '•E.2J-1' 2 + # 2 » e k, 2j l|2 > 


= U| 2 (^- + ^) by (4.2), 
r k k 


N— 

The proof for is analogous. 


Next we establish convergence results for the piecewise linear projec- 
tions of sufficiently smooth functions. 

Lemna 4.2: For <|>* e e L^(-h,0; I? 1 ) | e ^k’ 

k = ,p} 


(a) 


(b) 


N 1 C 1 “ 1 

H4> - <j> II < ~j I* I 

°° “ N 


IdV - Df 1 !. 


N = 1,2,' 


The constants cj, c 2 do not depend on N _o£ (j> . 

Proof ; The proof is based on an application of the Peano Kernel Theorem 
(see for instance [20], Th. 1.3). Let s e ij^. and define the linear func- 
tional F : W 2, °°(I^.; I? 1 ) -»■ Up by 

S KJ 

F g (4> 1 ) = ^(s) - *%). 

Fg(p) = 0 for all polynomials p of degree one, so the said theorem assures 

l + hs) -4> N (S)| = I F g ( 1 ) ( = |F g (J N ^(T)(.-T) + dT)| 

(4.9) IkJ 

< l/ N ♦ 1 (T)(8-T) + dT| + |(/ N 4> 1 (t)(--t) + dT ] N ( s ) I 

Vi Vj 

where 

(s-t) + = 

Now 

(4 * 10) l/ N 4> 1 (x)(s-T) + dT| = |/ N (|. 1 (T)(s-T)dT| < J (l) 2 II (J) 1 11^, 

Vj Vj 

where "r = max{r^, k - l,***,p}* To estimate the second term in (4.9), we 
define 

(4.11) 4» l (t) = J N <f> ^ ( t )(t — x )_j_dt , t e , i|> l (t) = 0 elsewhere, 

Vj J 



so that 
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l(/ N * 1 (T)(.-T) + dx) N (s)| = |l)» N (s)| 


P 

I I 


2N 

I 


m=l £=1 


N , .,N | . 

e .(s)^ I < 
mil mJt 1 — 




I* 


N 

k,2j 


But from (4.11) 


h ^ 1 n . 


- ^20^ 


' 1/2 (^) 5/2 » i l l 


Hence, by (4.6), statement (a) follows. Similar methods for the functional 


G g : W 2 ,0 * ( ; I?) + I? 1 , G e ((j> 1 ) = D<J> L (s) - D + <(. N (s), and the fact that 


s 


i.N 


n +,N 2N N .» . 

D * ’ e k,2j-l^k,2j yIeld <b) ' 


As an immediate consequence from Lemma 4.2 (a), we see that the sub- 
spaces Z N defined in this section satisfy hypothesis (H3), since the set 

e M 2 | e If?*, <|>*| T e W 2 ’” (I,; I?*), k » l,»»«,p} is dense in 

| k 

and flp N H = 1 for all N. 


4.2 The approximating semigroups and their generators 
Definition 4.3. For <J> = ,<J> ^ ) e we define 


A N C «J> ° , <b 1 ) = (A 0< J.° + l A fc 4. 1 (-h k ) + / A 01 (s)4» 1 (s)ds, dV + - ^(O)) 

k=l -h 


* S j, • ♦ 1 < *e» + % - ♦ 1<t >- 


Since D + <J>* e for <|>* e Y^ it is clear that is a linear 

N N 

operator Z + Z . 



Lemma 4*4: The adjoint of A N is given by 


, A N * .0 /aT.O . ,l /n . /a T ,0 v N n +.l r x n+ /aT ( 0. 

(A ) (ip ) = ( A 0 ip + (0),(A Q1 ^ ) - D + 2, 6 kN^\^ 5 

k=l 


, P r 1 r .N+ . 1 x N-» ,.l, N .. . N r l ,N+.1, N-. , 1, N „ J+.,l. .... 

* Jj £ { kj * ( V ' ( * (t W )) + £ V* (t pj> - * ( V> ' ^pN ^ ( - h))) 


4: ,,0 ,K „N 

for (r^ ,\p ) e Z . 


Proof : Evaluating , A^(<|>^ , (J> ^ ) > for e Z N we get by 


Proposition 4.1. 


J P 




k=l 


k=l 


and, since <}>^ e Y N , 


0 „T 


f . 0 . / x,!/ \ i ,.T ,0 1. ... T 0.N 1. 

J 4> A 01 ( s )4> ( s)ds = <A n ,i|) ,<p >, = <(A n ,ij) ) ,$ > 


-h 


or 


or 


>+x 1 


Integrating by parts the term involving D <f> yields 


p N-l 


<* 1 ,dY>,- l l YctJ^Vcs) - 


k=l j=0 


V V , 1/..N xT.l^N . 

I l * (t k1 ) 4> (t. .) 

k=l i = l - 1 - 1 


<D% 1 »* 1 >, 


Furthermore, 


- 4> 1 (o))> 9 = (<fr° - ^ 1 (0))% 1 (0") = ♦ho) 7 * 0 - t 1 (0) T <|, 1 (0), 


so that 
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<(a N )*(^° ,^ 1 ),(4,°»(f> 1 )> 2 = (aJ*° + ^ 1 (0)) T 4>° 

M 


+ < k‘l + <*/>' " D+ ^ 1 » ^ 1 > 2 + A » 


where A is given by 


p N-l 


p N 


a = -V(o)V< 0 ) + i i + (tk7) * <s> “ i i thovu" > 

k=l j=l 3 k=l j=l J 1 


p-1 N 


+ J. 1 . <* l -% c* 1 ^) - ♦ l <tJS»> 2 + T V.^ht".) - ^(t^))> 2 . 


k=l 1=1 


N-l 

I 

i=i 


1/.N-, 


The last two sums are transformed using (4.7). Observing <J>*(0 ) = <|>*(0) 
N N 

ancl t kN = t k+l 0’ k = 1»***»P» then arranging A appropriately we get 

X X ( * ( v " ♦ (t kj }) ♦ (t ki } 


N-l 

I 

j = l 


• V ^ . 1 r ^ N “ > nnT.I^N n ,1/ usTx 1 / i \ 

+ L (♦ (tpj) " $ (t rt4 )) ♦ (t^.) - (-h) <() (-h) 


PJ 


*Pj‘ 


and the result follows by applications of (4.8). 


The next lemma shows that the operators A N satisfy the uniform dissipa- 


tivity condition (HI) in the space defined in Section 2. 

n 


Lemma 4.5: For all N and all <f» e Z N , <A N <t>,4>> < o> B <|> II ? . with 

g _ g 

a) given in (2.4). 



Proof : As in Proposition 4.1, it is easy to verify that, with respect to 

the weighting function g(s) =p-k+l, se I^» k = l,»»»,p, we have 

<6”"(5),«j. 1 > 2 = p.C T 4 > N ( 0 ~), 

Tj 

g 

<6 k7 (5 ) » <frl> 2 = (P~ k+1 )C T A^"), k = = 

Li 

g 

< 6 ^(C), 4 » 1 > 2 = (p-k)? T <|. N (-h"), k = l,...,p-l 

Ij 

R 

1 2 

for all $ e L (-h,0; M 1 ) and £ e if 1 . From these equations and the 
definition of A^, it follows 

<A H *,*> g < (a/)V + l |aj u 1 (-h k ) | u°i 

k~ 1 

0 i n p N + i t i 

+ I / A n , (s)4> (s)ds| 1 4> I + l (p-k+1 ) l f (D 4 > 1 ( s ) ) 4 > 1 ( s )ds 
-h U1 k=l j -1 i”. 

+ p($° - Ao)) T ^( 0 -) + l V (p-k+ixAtJJ ) - ♦ 1 (t£l)) T 4> l (t k “) 

k=l j=l J j j 

I (p )(4> (t^) <|> $ ( fc kN ) 

k=l 

for .J) e Z N . Using 

J N (D + ^ 1 (s)) T 4 , 1 (s)ds = 7 (U 1 (t k " j _ 1 )| 2 - U 1 (t kj )| 2 ) 

Ik i 


and the inequality ? T n < 1 (|g| 2 + I n 1 2 ) , 5, n e Iff 1 , we get 
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<A N 4>,<J>> g < ( A 0 <(> ° ) T <f> ° + j I ( | A k | 2 II <(> II 2 2 + |<|> 1 (-hi k )| 2 ) 

k— 1 M 

+ iia^ 1 ii 2 ii<j> 1 i +i I (p-k+ 1 ) V 1 4> 1 ( t^T ) | 2 

w k=l j =0 - 1 

■ 7 1 (p-k+i) i 1 ( t ui >1 2 + p( k°) I ♦ l <o> ! - 1 4> 1 (o) ! 2 > 

k=l j=l J 

♦*£ <p - t+1) X ltl(t « )|2 - 7 j, (p - k+1 > X 

*7? (P-U) u l (t ^)| 2 

< ( V W +j U° 1 2 + 4 JjKI 2 + " A 01 II l 2 ) 

+ 7 l k )l 2 - flAo)! 2 -i I (p-k+ 1 ) l+Vt” >| 2 

L k=l K 1 1 k=l kN 

+ j l (p-k+ 1 ) l4» 1 (t{J “)| 2 +1 Ycp-kJl^Ct” )| 2 
k=l K L k=l 

■7 I (p-k) U 1 (t^ N ) | 2 < ul*l g , 
k- 1 

because, due to the weights, all terms except the first three neutralize each 
other. 

■ 

Looking for appropriate sets to be used in (H2) and (H2*), we define 
D - { (<p 1 (0) ,<p 1 ) e M 2 | (f) 1 e W 2,ot, (-h,0; if)} 

and 

D * = (('I' 0 ,'*' 1 ) e dom A* | ip 1 e W 2 »°°(I k ; I?) , k = !,•••, p}. 
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The following Lemma occupies (H2) (ii) and (H2 ) (ii). 


Lemma 4.6: 

all <(> e D 


(a) There is a constant c > 0, such that for all N 


N N c "1 

II A p <f> - A$1 < - II4> II . 

IM 00 


(b) For all ^ e D 


, N * 

II (A ) p ij; - A ij;ll ■+ 0, as N ■* 00 . 


Proof: (a) From the definition of A and we have the estimate 


ha N p N <(> - a*h < l |aJ |<|> N (-h k ) - ♦ 1 (-h fc )| 


k=l 


+ / |A (s)(<J> N (s) - <j> 1 ( s ) ) | ds + II D + <j> N - D<|) 1 1 


-h 


01 


0 N N 1 

+ IS 10 (♦ - + (0) ) II 2 + HA ( <t> ) II 2 


where 


A*‘> - I Y « N - 


J k=l 


p-1 


k=l i=l 


kj ^ VL kj 


K N,.N- 
► (t kN }) 


= A^(4> 1 ) + 


By proposition 4.1 and Lemma 4.2 for <f> e D this yields 


.N N 


c, c. 


1-2, ,,N ,1/2 _3 } „Jl lleo + I|A N U 1 )|2 


IA* p * - A+l < (_i + + 2(— — ) 

N r i N 


and 
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with some constants cj, c 2 , C 3 . Since (fi 1 is continuous on [-h,0] one 
has 


^ N(t kN } " <frN(t kN )| i 2I1 ^ " + 1 "- <4 k = 

N 


so that 


II A^(4» 1 ) II 9 < 2 (— ) 1 / 2 ( p- 1 ) C °y S - t II <(> 1 II > 

4 z — r -_4 00 

— N 


with r « min {r , k = ,p}. Taking advantage of the orthogonality of 

" K 

2N in L 2 , we have for £ e 


.1 I Y «"T(5)«2 < MN-1) I Ul 2 . 
k=l . 1-1 KJ 1 - - 


Hence, 


HA 


N, K„ ✓ V /„ ,\ N. 1/2 |.N, N 

^ 4 . )ll 2 £ 2(p(N-l) -) max |4> (tj.) 

— k= 1 , • • • , p 


.N^N-,1 ^ const ~l 

* (t kj ) * i — W~ '* ' 


j®l » •• • »N 


This proves (a). 


(b) From Lemma 4.4 and the definition of A we have 


ll(A N )*p N i|> - A%l < |A^° + /(0) - (A^° + t^O))! 


!(Aj/) N - Aj/« 2 + »dV - D(^ + l ^° X[ _ h> _ h ))»2 + » aN < + >'2* 

k~ 1 k 


- f 0\V) ♦ Y 1 (/(tj) - ♦*<«;, 


4 N ‘(*> - l «£<*£♦' 

k=l kN * k=l j=l 


)) 


where 



+ s l 


Since (H 3 ) is valid II (A^// - aJ^ 0 ! ■*. 0 . 

If * e D*, |/( 0 .) - /( 0 )| <S ™ £L |Jl |w# Defining * l = ^ a T / x 

i kj N ^ 

we have ? e Y N for all N, D +* 1 = 0 and / +^ r e W 1 > 2 (-h, 0 ; IP) 

if ^ e dom A . Hence 


hdV - D(/+/)n < (h ) 1/2 iidV+/) N - d(^ 1 +u; 1 )ii < const: 

L 00 — N 



!! . 


00 


by Lemma 4 , 2 . We arrange 



Recall, that for ij> e dom A*, /(-h) » 
k = 1 , • • • ,p-l , so that 


<S K*°> + »>*<& - *X„>» 

= 4^ (i^> + A ^ (ip) + A^ (\p). 

?ip° and /(-h k ) - i^ 1 (-h~) = aJ/, 


« A^(i|) ) II 2 = «6^t(^ 1 <-h) - /(-h))|| < 2 (2L) 1/2 n/ - ^N„ < const Jl, 

P 1 “ r p °° “ N J/2 

and 

l4 2 ^ ) " 2 ‘ ' - ♦'(-h") + *i N (-h“) - * N f-h k ))I 2 

< 44) 1/2 (p-i)M,‘ - A < £Sii . 
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Finally, can be estimated like A^ in part (a), namely 


*N*/,x x const ..VI.. . n * 

A3 (i|>) <_ — — llt|) «„, ^ e D . 


In order to apply Theorem 3.1 to A N and (A N )* of this section, it 
remains to show (H2) (i) and (H2*) (i). 


k k O 

Lemma 4.7: The sets (X-A)D and (X-A )D are dense in M , if 

X > to as given in (2.4). 

Proof: Due to basic facts in semigroup theory, we know from (2.5) that 

* 

U e $1 Re X > u>} is contained in the resolvent sets p(A) and p(A ). 

-1 * -1 

Hence, if X > w, the operators (X-A) and (X-A ) exist. 

Therefore, given \|> e Iff 1 * C*(-h,0; If 1 ) the equation (X-A)<J> = ^ has a 

unique solution <(» = (<|> ^ (0) ,<}> ^ ) e dom A, which by the definition of A sat- 
isfies X^ 1 - I 1 =<|» 1 . But this implies = X(J> 1 - iJj 1 is continuous and 

differentiable. In fact, <j> ^ = X$^ — ^ is continuous, so that <j> e if 1 x 
C^(-h,0; if 1 ). Hence the dense set if 1 x C* is contained in 
(X-A) (I? x dom A), which is a subset of (X-A)D. 

The same arguments applied to ^ 1 1 e ^(I^llf 1 ), k = l,»««,p, reveal 

that (X-A*)D* is dense, if A^ e L ( if'jC^-hjO; if 1 )). Let 

X > w, <(. e M 2 , 0 < e < ll<M and A Q1 e L (lf 1 ;L 2 (-h,0;lf 1 )). There is a 

£ 

A^. e L (if'jC^-h.Ojlf 1 )) with corresponding generator A satisfying 
01 ^ 

"k ie ^ _ 1 _ ^ ^ 

11 A —AH „ = D A rt1 - A^.n 0 < e ( 4 11 ll II (X-A ) II ) , X e p (A ), 

l (m ) l (ir- ;l ) 


-36- 


and II (X-A*) *11 < 2 ll(X-A*) _1 H (cf. [15], IV. Th. 1.16). Let 
c — 

such that II (X-A )il> - 61) < e. Then II (X-A II < 2 II <p\\ and 
c c c c — 

II (X-A H - <(> II <11 (X-A H - 4)11 + II A - A ll lit II _< e + e( 4114)11 ll (X— A ) -i 
C ■” c c c c 

< 2e , because I* 1 < ll(X-A*) _1 || ll(X-A*)t c « < 4|| (X-A *)" 1 II Ii 4 .ll. 

k k 

proves the density of (X-A )D . 


* 

\p £ D 
c 

11) -1 nt c » 

This 



The proofs of the Lemmas 4.6, 4.7 do not use additional smoothness assumptions 
on Aq! as it is the case in [12], [13], [14]. 

Summarizing, we can now say that the semigroups S^(») and S^(*) 
generated by A N p N and (A N )*p N converge to the hereditary semigroups 

k 

S(0 and S(*) in the sense of Theorem 3.1. Also, Theorem 3.3 holds so 
that for the finite time horizon control problem we can approximate the 
Riccati operators and the optimal controls by solving the finite dimensional 


systems (3.4), (3.5). 



-37- 


4.3. Vector dominance preservation 

•» a n A N N 

With respect to the basis e 0 ,e ll ** * * ,e p 2 ^ of Z and the canonical 

basis of H? the matrices [A N ] and [A N *] representing A N and A N * are 
given by 


(4.12) 


r .N, /ri N^ -IN . r .N*, ,.N,.-1 U NT 

[A ] = (Q ) H and [A ] = (Q ) H 


<e 0 ,A e Q > 


" a N"N s 
< e 0’ A e p,2N > 


, N = 1,2,. 


/N A N* n 

. <e p,2N* A ®0 > 


/N ,N A N . 
p,2N p,2N - 


For the computation of the entries of H , observe that the derivatives of the 
basis elements are given by 


d + S - , A* N 2N N . . . , „ 

dt e k,2j-l“° and It e k, 21 --?T e k, 2 . 1-1 • " ' 3 * 


Written in the simplifying nxn matrix notation we get for example 


.1TN _ , . N 2N N J-. T . .N- . .. 

A e k,2j A k,2j ’ r^ e k,2j-l " 6 kj (I) " 6 k,j-l (I)) » 


k =!,••• ,p, j = !,*••, N-l, 


with 


A^ = / A 01 (s)e k ^ (s)ds, k = !,•••, p, .1 = !,*••, 2N, 
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The inner products in H N are evaluated using the orthogonality of the basis 
elements and Proposition 4.1. The result is the n(2pN+l) square matrix 


h n = 


.N 



k h 


where 


a n ,.n .n 

\ " (A kl A k2 


W M M 

A LN 4* A A — a ^ 

A k,2N-2 A k, 2N-1 A k A k,2N V 


is a nx2nN matrix, k = p, k^ = a 2nxn matrix and 

h * (_* -1^ ^ ^ ~ Ij) are 2nx2n matrices. Numerical algorithms 
solving high order systems with coefficients [A N ] might take considerable 
advantage from the fact that H N has band structure (not the case for the 
Legendre methods [11], [12], [13]) and that is diagonal (not the case for 

spline methods [14]). 

In the following, we exploit the structure of the matrix [A N ] in order 
to deduce the VDP property and (H4) for our piecewise linear approximations. 


Lemma 4.8: If there is a _> 0 independent on N such that for 

all e Z N 

CO 

/ J vs N ( t )d> i 2 dt < c~ B 4 >n 2 , 

0 

then 

oo 

f ii s N ( c )<p n 2 dt < c, n <j> a 2 , 4. e z N , 

b 1 


for some >_ 0 not depending on N or 
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N N *N N . N 

Pro of: Let <J> e Z and set S N (t)<f> = e A p t <j> = e A % = 


(wg(t), wj(t)) e Z N , t > 0. With w - L A 

1 k=l 

coefficient vector coKw^O.w^t) .... ,wjj 2N (t)) is the solution of 


*'>-! !«<«> 


( 4 . 13 ) ^ 


1 


w 0 (t) 

N 

W li 


- [a n ] 

w ll (t) 

1 

■ ■ J 

,2N^ 


1 

N , x 

_ W p,2N ^ _ 


, t > 0, 


Wq( 0) = <j) 0 

N N 

W kj (0) = *kj 


the 


A view of the rows of [A N ] reveals that (4.13) implies 


•N / 1- \ 

v n (t) ■ 


N N > . N N, . 

"7^ av ll (t) + 7^ v o (t) 


(4.14) 


>N 


\l (t) ■ - r 


N N 


N . N 


av H (t) + 5T b Vl,N (t> ' 

k 


v^(t) + hv^U), k . p, i . 

K. K. 

v“.(0) - k - j. 


where vjJjU) - (t) , wjj > 2 j (t)) e «£", e"(t> - col(w“(t), 3w“(t)) 

and a = (* i)® I, b = ( * 1) ® I. Using (4.6) we get 


(4.15) 


l\j (0) I 2 - H® 2 . k * 1. ‘“.P, j = N. 


To estimate the solutions of (4.14), we make use of the fact that, if 


f e L (0,»; ]R), a > 0 and g(t) = f e 

0 


-a(t-s) 


f (s)ds, t > 0, then 
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o 

g e L (O, 00 ; 1R) and 
VI. 2.33). 


/ g 2 (t)dt < ~ j f 2 (t)dt 

0 a 0 


The first equation in (4.14) yields 


(cf. for instance [10], 


N , N 

v u (t) 


N_ 

r, 


at 


= e 


Vj (0) + / 

11 0 


N , v 
- — a(t-s) 

1 


Vq(sMs, t 0. 


With v^Ct) = v^(t) - e 1 v^CO), t > 0, we get 

2 OO 

/ Iv 1 ?, (t ) ! ^ < — \ f e 2 ^ |v!?(t)| 2 dt _< const / |w!?(t)| 2 dt = 

0 N 0 0 

" N 2 2 

= const / | VS ( t ) 4> | dt <_ const |[ cf> II , 

0 

by assumption, where the constants do not depend on N. Using (4.15) it 
follows 


(4.16) 


/ |v ( t ) I dt < const ll<j>ll . 
0 


Estimating the solutions of the other equations in (4.14) by the same method 
yields 

OO 00 

/ |v” . ( t ) 1 2 d t < const ll<J>ll 2 if f |v?J . ,(t)| 2 dt < const ll<j>ll 2 , 

o K,J o k,1 ~ 1 

k = p, j = 2 , • • • ,N 


and 


f |v?\ (t)| 2 dt < const ll<J>l| 2 if / |vf . „(t)| 2 dt < const » <(> II 2 , k = 2,»**,p 
0 kl “ 0 ’ 


So, from (4.16), we get by induction 


f |v^.(t)| 2 dt _< const llijill 2 , k = l,**«,p, j = 1,»**,N. 
n 


But this proves the assertion of the lemma, because by (4.3) 


.s’W - l-S(t)i 2 ♦ f I tr l w k,23-i (t) l z + 35 l“k,2 J (t) l i ] 

k=l j =1 


2 , k i N 


= |wJJ(t)| 2 + I l ^|dv” (t)| 2 , 
0 k=l j=l 1 


where d = ( ^ ^ ) (B> 1 

0 /T/3 


so that 


„ p r, N _ " „ 0 

N # . » i 2 . . . r k r i . i 2 e i N /. \ |2. 


J IIS N (t)<M 2 dt < / K(t)| 2 dt+ l l |d| / |v (t)| dt 

0 ” 0 0 k=l .1 = 1 0 J 


< const II <f> ir 


■sN , 


Corollary 4.9: The semigroups S (•) generated by 

l^p N = (A N - B N R -1 (B N )*n N )p N satisfy hypothesis (H4). 


Proof: Since B N :I? Z N is represented by the n(2pN+l)xm matrix 


(4.17) 


[B N ] = col(B 0 ,0,..*,0), 
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the matrix [A^] differs from [A N ] 
Therefore, (4.13) with [A N ] replaced by 
rest of the proof remains unchanged. 


only in the first n rows. 
[A^ ] again yields (4.14), The 



Besides for (H4), the VDP-property of the piecewise linear approximations 
together with the results of the next section will be used to deduce (H5). 


4 . 4 The eigenvalues of the approximate systems 

It is known that the spectrum of the generator A coincides with its 
point spectrum namely cr(A) = (X e | det A(X) = 0} where 

p -Xh 0 

A(X) = XI - y A. e - f A m (s)e As ds , X e $. 
k=0 c -h U 


The eigenvalues of the finite dimensional operators A^ are the zeros of 
det(XI^ - [A^]) in <£. 1^ denotes the n(2pN+l)-identity matrix. In order 

to calculate the determinant of the characteristic matrix 
A (X) = XI - [A ] in terms of rational functions of X , we transform 
A^(X) by elementary row and column operations. 

First, for all k = l,»*«,p and j = 1,«»*,N multiply A N (X) from 
the right by the matrices 



the only nondiagonal identity matrix being at the position ((k,2j-l), 
(k,2j)). The resulting matrix is multiplied from the left by 
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,N 



, L J ^ 6N.-1-.N 

with C. . = (X + — ) (A 


kj 


+ a, n oj > 


k, 2j-l k,2j 


so that the first row of blocks now is given by (Bq 0 B^ 2 0 B^„ 0) 


pN 


with 


N 3N N 

B o ■ AI - A o - r; c i2 


<■ 

kj 


.N 


3N „N 3N „N 


1 ' S.2,-! + t % -F fc C M + l- k J ‘ 


B 


N 


.N 


kN " Hc^N-l + r R C kN r k+ ~ "k+1,1 


3N „N 3N N . . . 

- C. J . 1 , , k = !,•••, P-1 


B» = -A - A N H c N n . 

pN p p,2N-l Tp pN 


Then multiplying from the left with 


r N 

kj 



, k = !,••• ,p,j“l,»»»N 


where the only nondiagonal block is at ((k,2j-l) ,(k,2j )), yields a matrix 
whose diagonal looks like 


N 


r 1,, 


3N 

r. 


N, '> 
-p k (*> 


3N 


•- r. 


X-K 6 ” 

r k 

0 

0 


0 

0 


N, v 
q k ( x) 

3N 


0 

0 


xMj 

r k 


01 . with 


-44- 


(4.18) 


N,, 

P k (X) 


N,,. 

q k (x) 


N_ 

r. 


H x( x + — r 1 

r k r k 


N, 


X + p"(X) 


, k = 1 , • • • , p. 


We define 


°PN - <- B pN )(q p (X))-1 


D kj ‘ (_B kj )(q k (X)) 1 + D k,j + l P k (X)(q k (X)) l > k = ^“.P. J = !■»•••» N— 1 


(4.19) 


°kN ^~ B kN^ q k^ X ^ + D k+l,l p k+l^ X ^ q k^ X ^ *» k= 1, 


Mu 1 '.io l i. r a l. i o n f com t he Left w l 1 h 


D» . 


I o> d " 2 0 


N N 

subtracts p 1 (X)D' 11 from the upper left block and sets all other entries in 
the first row of blocks to zero. Thus 

(4.20) det A N (X) - [ n (det q k (X)I) N (det( X+ — )I) N ]det aJJ(X), 

k=l K r k 0 

where 


Aq(X) = XI 


A - 3N r N 
0 C 12 


pJ J (X)D 


N 

11 * 


(4.21) 
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Note that these transformations are possible, as far as X + — £ 0 and 

r k 

q^(A) t 0, i.e. , X £ - — and X ^ — ± i— /2 , k = 1 , • • • ,o, in particular 

r k r k r k 

if X e {X e $|Re X -p> and N !> ~ for some p > 0. Further note, 

if Re X > -p , then det A N (X) = 0 iff det A^(X) = 0, provided 

N > — . From (4.19) we get by recursion 



k = 1 ,••• ,p 

where 

(4.22) r£(X) = p k^ X ^ q k^ X ^ _1 ’ k = l »*'*» p * 

Using this in (4.21) yields 

aJ(X) = XT - L N (X) = XI - (L^(X) + L»(X) + L^(X)) 

with 

l”(X) 

l; ( x) 

(4.23) 

l!J(X) 

-(r^(X)) j ). 


{? k n N 

V + I n (r"(X))\ 
k-l i-1 1 K 


p k-l 


= I l (r"(*)) N l Aj 2 . j(rJ(X)) J 
k=l i=l i=l ’ 2 


N 
y 

t 

j= 

k-l 


V 3N 6N.-1 k " X , N,. v »N ? . .N N ... N 

Z r~ (X+ rT> A (r i U)) (A k, 2j -l + V2j )((r k 
=1 k k i=l J=1 


(X)) 


-I" 1 _ 



-46- 


Proposition 4.10. (a) W ith the projection V: -► introduced in (H4) 

we have 

t V ( X I - aW] = (Aq(X)) - 1 , X e p(A N ). 

fu\ f N y. svN “ r k x , N,, v . , . 

(b) (r k (X)) * e and r^CX) ->1, k = 

as N uniformly in X on bounded subsets of 

(c) _If_ Re X 0, then | ( X ) | _< 1, k = 1, • • • ,p. For any 

there exists N(p) such that for all N N(p) and all X e ((; 

Re X e [ -p , 0 ] 

|rJJ(X)| < |r k (-p)| , k = 1 , • • • ,p. 

N 

Proof : Expanding the determinant of A x (X) by elementary operations, 

we have "seen that T^A^(A)S^ = U^(A), where U^(A) is a lower triangular 

block-matrix with A^(A ) in the position (1,1) and S N ,T N are regular 

matrices given by S = n II S, . and T w = D N H II Tv.C . The 

k-1 j=l 3 k=l j=l * 3 

first column of blocks in T N and the first row of blocks in (S N )~^ are of 

the form (I 0 0). Thus, the application of these transformations to the 

equation A^(A)(^* *)^ = 0)^ yields 


p > 0 
with 


U N (X ) (^°* *) T = t n a n (x)s n (s n ) h* 0 *- 


-*) T = 


- AA 


0) T = (A 


0 ) 


T 


*) T = (U N (X ) ) A°0- 0) T for all e BP. 


or 
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This implies ^ = (Aq(A)) ^ * ® ut 

V(XI - aW* 0 = V (XI - A N ) _1 (d) 0 ,0) = [V ] (A N (X ) ) -1 (<t>°0 0) T 

= [V]0|i°* *) T = = (Aq(A)) 1 <() 0 , 


for all e if 1 , and this proves (a). 

From (4.18), (4.22) we have 


N/, N _ 

r k (X) - ^2 


6N - 2Nr k X 


6N + 4Nr^X + X r fe 


^=«' r 4-^+-2 


, V 

3r. X 
k 


61^ + 4Nr k X - 2r k A 2 


■r 1 . 


k - 1 ,••• ,p. 


This proves (b), because, as N + ® 


, 2.2 
3r. X 
k 


r, X _ M -r, X 

(1+ . — -) e and (1+ s 2^7 

N 6N + 4Nr, X - 2rfx 


) N - 1 


uniformly in X on bounded subsets of 

Finally, an explicit computation of |r k (A)| 2 and its derivative with 

respect to ReX shows (c)* 


The 


properties 

Aq(A). 


(b) and (c) are essential for the convergence of the 


matrices 
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(b) If det a|J(X) = 0 and Re X > 0, then |x| < j? l\l + 3 l,A 01 " 


For any p > 0 there Is an N(p) such that for all X 

Re X e [ -p , 0 ] and all N > N(p), det A^(X) = 0 Implies 

M < l 2 k e phk K| + 20e ph HA II . 
k=0 L l 


Proof : Set A^(X) = XI - L^(X) - L^X) - l!J(X) as In (4.23). 


V X) ♦ A + l A^ E e = l 
k=l 1=1 k=0 


k -r . X p -h t X 

„ i f k 
II e = ) e 


vr P h.. - X 

11m L.(X) = l e 


N 0 


11m l / A 01 (s)e£ 2 1 (s)(r^(X)) 3 ds 

j=l -h ’ 3 


uniformly in X on bounded sets* 


Let s e 1^. To each N there is a unique such that s e I 


lim l!?(X) = l e k 1 lim / A n (s)(r?*(X)) N ds. 


I, 


From 0 < + N(h^_^+s) /r^ _< 1 and Proposition 4.10 (b), it follows 


N ^k— 1 "*" S ^ r k N 3 N 

lim [(r”(X)) k 1 k - (rJ(X)) N ] = 

N-*» K 


hence 


N ~N(h +s) /r, N 3 N"*"^ k k— l"*" S ^ r k 

= lira (r”(X)) k 1 k (l - (r?(X)) N k 1 k ) = 0; 

N+~ 

xt j«j M -N(h ,+s)/r (h , + s)A 

11. (r?U)> ” - Um (r?(X» M k - e k ~' . 

N+«> K 


7? & 
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The convergence is uniform in X on bounded sets and in s e 
dominated with respect to s. Therefore 


lim C(X) 

N>» 


P ~ 1 X 

I e J 

k=l I. 

k 


( h k _i+s ) X 
e ds 


/ A (s)e Xs ds, 


For L^(X) in (4.23) we get 


L*tt)| < I |H <X+ |E>- 1 | k n' |r”(X>| H / I A 01 ( S )( r »a)) J »|d S Kr^CX))- 1 - 1 


k=l k 


k i=l 


((rf(X)) 1 is defined if .M t X, k - l,.«*,p), so that L^(X) > 0 
k r k 

uniformly on bounded sets. If det A^(X) = 0 then \ is an eigenvalue 

of L N (X). Therefore det A^(X) = 0 implies |x| |L^(X)| + 

| L. ^ ( X ) | + |L^(X)|. So (b) is proved by similar arguments as (a) using 
Proposition (4.10) (c) and the convergence of r^(-p), (r^(-p)) N and 

/ N/ >,Jn 

(r k (-p)) . 


For the investigation of the asymptotic behavior of the eigenvalues of 
A^, N we now use the following consequence of RouchS's Theorem: 


Proposition 4.12. Let f, f N , N = 1 , 2 , • • • be holomorphic inside and on a 

, . N 

closed bounded contour T <p. If f has no zeros on V and if f ■* f 

uniformly on T , then there exists an e IN such that for 

N _> Nq, f^ and f have the same number of zeros (counted according to their 

multiplicities) inside F. 
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For p > 0 define G^ = (X e $|Re X -p}. Since det A(X) is 

analytic on and its zeros lie in {X e $|- p _< Re X _< 0 and 

| X | < l e Phk |A, | + e ph HA II }U {X e $|Re X > 0 and 

k=0 L 

11 the number of eigenvalues of the generator A 

L 1 

in G is finite. Similarly, from Lemma 4.11 (b) and the notes following 
P 

(4.21) we see that, if N is sufficiently large, the eigenvalues of A N in 

G lie within 
P 


< I 

k=0 




+ 11 A, 


01 


p k ph k, 


K - U € t|- p < Re X < 0 and |x| < J 2 K e *1^1 + 20e l>h IA 01 l ^ 


k=0 


UU e C|Re X > 0 and |x| < £ |aJ + 3 II A I } 

k=0 k Ui L l 


Although these estimates are not accurate, they lead to rigorous results given 
in 


Lemma 4.13: (a) If Xq is an eigenvalue of A with multiplicity k, 

then for any e > 0 (small enough) there is an Nq such that each 
A n , N Nq, possesses k eigenvalues in B(X Q ,e) = {X e $ I |X — Xq | < e}. 


(b) Let 
G p * F° r 
operators 


p > 0 and 
any e > 0 
A n , N > N q , 


X^, i « 1,«»«,£ be the eigenvalues of A in 

(small enough) there exists Nq such that the 

l 

have no eigenvalues in G\lJ B(X.,e). 

a p i=i i 
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Proof ; Assume that Ag is the only zero of det A(A) in B(Ag,e). 
3B(Ag,e) is bounded and det Ag(A) -*• det A(X) uniformly on bounded 
sets. Thus, (a) follows at once from Proposition 4.12. 


Choose, without loss of generality, e > 0 such that det A(A) has no zero 

in 3G U U 3B(A.,e). We know from (4.20) that, if N > — , A e G is 
P . , i „ — r P 


i=l 


an eigenvalue of A N iff det Ag(A) = 0. Write G^\ B(X^,e) = G^ u G 2 , 

where 

G. 


: - (G Hk ) \ U B(X.,e), G = (G Pi K°) \ U B(X ,e). 

1 P P i=1 i z p p i=1 * 


G^ is bounded and 


an 


3Gj contains no zero of det A(A). Thus, there is 

N, > ^2. such that for all N > N, det A?(A) has as many zeros in 
1 — r. — 1 0 

N/ 


Gj as det A(X), that is det Aq(A) has no zero in Gj. Since 


G 2 C Kp, there is no eigenvalue of 
large. 




in Go , if 


is sufficiently 


This shows that the eigenvalues of A are approximated by the eigen- 
values of the operators A^. Moreover, given e > 0, let p e 1R and 

A^, i = 1, •••,£, be the eigenvalues of the hereditary system with 
Re A.^ _> P. Then the piecewise linear approximations do not have eigenvalues 
in the right half plane Re A > p outside the balls B(A^,e), i = 1, •••,£, 
provided N is sufficiently large. 
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4.5. Uniform stability 

From the results of the previous section, we conclude that, if S(*) 

-o) 0 t 

is stable, i.e., II S ( t ) It <_ Me with some M, > 0, then for all 

w < to- there are an N and constants M w such that for all N > N 
0 a) 1X1 —oi 


(4.24) 


If S N ( t ) II < M T e 
— N 


—cot 


In order to get uniformity with respect to N on the right hand side of these 

estimates, we follow an idea given by K. Ito [12] in connection with his 

Legendre-tau approximations. The idea is to establish uniformity in (4.24) 

for one special no-delay case and to interpret this special case as a 

perturbation of the general situation. 

Let us consider the equation x(t) = -x(t), t 0, in f as if it 

were a functional differential equation with p delays, demanding the initial 

2 

condition (x(0),x^) « <f> e M . We approximate by our piecewise linear 

N 

scheme, denoting the approximating generators by A^. They are given in 

Definition 4.3 where = -I, A^ « 0, k = l,*«*,p and Aq^(*) = 0. The 

N 

representation [A" ] is a lower triangular block matrix with -I in the 

[Afllt 

left upper position. Therefore the first row of blocks in e is given 

by (e _t I 0 ■— ■ ' » 0). Hence, for all <(> e Z N 


N 

I Ve 0 *| = 


0 


[A~]t 

(e a (<t>))| = 


e“ t a 0 (4.)| = 


-t, .0 


If 


< e 


-t, 


<t> n < 


Thus, by Lemma 4.8, there is a c > 0 such that 


/ lie ° <j>l | 2 dt < c II <}> ft 2 , <f> e Z N 
0 


(4.25) 
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and by Lemma 3.4 there exist constants Mq, > 0 such that for all 


N = 1 , 2 , • • • 


lie 


❖ 


.N 


-a. 


< V 


t 

9 


t > 0. 


Remark : Guided by these arguments, one easily sees that the spline 

approximation scheme presented in [14] does not have the VDP-property. 

Because the first row of blocks of the matrix representing the spline genera- 
s N 

tors is also of type (-1 0—0) one gets for all <j> in the 

s * N t 

KT ^ a . 

spline subspace S Z , |(e <j>) | <_ e II II , as above. Thus, if a spline 

s A N t 

analog of Lemma 4,8 holds, then by Lemma 3,4 He | s Nil < Ke , for 

Lt *“ 

some K, e > 0, independent of N. But this contradicts the peculiar 

eigenvalue behavior of the spline scheme (see [14], Prop. 5.13). 


-w 0 t 

Lemma 4.14: _If_ II S ( t ) II <_ Me , t >_ 0 for some M, > 0 then for 

all a) < there exist N and M such that for all N > N 

0 w — m 


.s"<t> 


y i 


Me 


-wt 


t > 0. 


Proof: Let 0 < to < io^. We have seen in Lemma 4.11 that there is a 
constant c such that |L^(-co+iT)| < c, x e 1R, if N _> N(<o). It follows 

K^C-m+iT))' 1 ! for ,_a)+iT,>c 

(det Ap(-o)+iT> £ 0 if N is large enough). Thus, from the uniform conver- 
gence of Aq(A) to A (A) on the set {A = -u + ir | | A | _< c> , w e have 
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(4.26) 


| (A -nu)H-iT ) ) *| < Y, T e IR, N > N 
U — — 0) 


with some N e IN and Y > 0. 

U> 1 

A 

Define A^ = o)I + A^ and let <f> £ Z^. The trajectory e <p Is 
the solution of 


z(t) = A^z(t) = A^z(t) + (A^ - A^)z(t), t >_ 0, z(0) = <j>. 


Equivalently, 


A^t A N t t A N (t-s) A^s 

e°Me% + / e (aJ - A^)e 0 <f>ds, 


0 


hence 


A t A-.t t A (t-s) A 
e 4> = e <J>+/e w Vf (s,ij))ds, 
0 


a N 

A„s 


N lyr S 

where f (•,<)>): TR if is given by f (s,<J>) = Fe ’ <j> , s > 0 


with 


F: M 1 -»• M 1 . 


(4.27) Ft - (I + Ml + A Q )t° + l A k t 1 (-h k ) + f° A 01 (s)t 1 (s)ds, 

k— 1 — h 


2 „ ^ ,^N a N, 

0) 

(4.27) and (4.25) it is clear that 


because the L 2 -component of (A^ - A^H vanishes for all \p e Z N . From 


(4.28) 


if N (- ,*)i 


,2,„ n <*"♦' 2 

L (0 ; TR ) M 


< > 0 not depending on N. We write 


for some 


O 23 
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A N t A»t 

Ve “ <(> = Ve (j> + y(t) , t > 0 


t A ( t-s) * 

y(t) = / Ve V f (s,<f>)ds, t >_ 0 . 

0 

A N, . 

M A (t-S) 

Letting f n (s,<|>) =0, s jC 0 and e u = 0, s > t or s _< 0, we have 

a n . 

f N 0,4>) e L 1 (1E; if 1 ) O L 2 ( ]R; if 1 ) and by (4.24) e u e L*( 1R; L(Z N ) ) 

P) ( TR; L ( Z”) ) , if N is sufficiently large. The calculation of the Fourier- 
transform y(») of the convolution y(») yields [10, (21.41)] 


y(x ) = (Ve “ V*) (x)(f N (* , <J> ) ) (t) = 


= / e lTt Ve W V*dt (f N (»,<}>)) (t) = 


= V(-a)+iT-A N ) *V* (f N (*,4>)) (t), t e K. 


By Plancherel's Theorem (cf. for instance [10, (21.53)]) and (4.28), we get 


/ |(f N (- ,4> ) )~ (x ) ! 2 dx = / | f N (t ,d> ) | 2 dt < k 2 ll<t>ll 2 . 

-OO 0 


/ |y(t)| 2 dt = / |y(T)rdT< 

0 -°° 


_< / |v(-w+ix-A N )' 1 V*| 2 | (f N (* , + )) (i)l^dx = 
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= / | (A^C-co+iT)) 1 1 2 ! (f N ( - ,4> ) ) (t)| 2 <1t 


by Proposition A. 10 (a). Therefore, from (4.26) 


/ | y( t ) 1 2 dt < Y 2 < 2 « <t> H 2 , N > N 

0 a 


and, by (4.29), (4.25) and Lemma 4.8 


» A N t 2 

/ lie $11 dt < const ll$ll , 
0 


N > N , $ e Z 
— or 


Lemma 3.4 thus yields constants M, e > 0 not depending on N, such that 


w t t 
e lie 


,N 


II = lie 


A fc t 

0) 


Jl < Me -et , N > N . 
,N — — 0) 


So, if the hereditary semigroup S(*) is exponentially stable with 
some decay rate it is approximated by piecewise linear systems with 
decay rate arbitrarily close to a)^. 

Another immediate consequence of Lemma 4.14 is 


Corollary 4. 15: The semigroups £>(•) generated by 

A N p N = (A N - BR 1 B*II)p N satisfy hypothesis (H5). 


Proof : 

solution n 
group S(.) 
approximations 


If the hereditary system is stabilizable, there exists a 
of the algebraic Riccati equation, and the closed loop semi- 

__ J * 

generated by A = A - BR B II is exponentially stable. The 
to !>(•) are actually given by S N (*). Thus the previous 
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lemma yields constants M, u> > 0 such that 


HS N (t) I N » < Me Ut , t > 0 


N for all N sufficiently large. 


Summarizing, we have proved that the convergence statements of Theorem 
3.5 are valid when the piecewise linear approximation scheme is applied to 
infinite time horizon hereditary control problems. 


4.6. Examples 

Testing the numerical performance of the approximation scheme developed 
in this paper, we have employed it in several examples and compared the out- 
comes with the results produced by other schemes. As far as these examples 
are representative, it turned out that the piecewise linear and the first 
order spline approximations [14] are of the same numerical accuracy (for the 
same approximation index N), but both are inferior to the Legendre methods 
[11,13]. 

In the case of the finite time horizon the Riccati differential equation 
^ [n N (t>] + [(A N )*][n N (t)] + [n N (t)][A N ] - 
- [n N (t)][B N ]R - 1 [B N ] T [n N (t)] + [w N ] = o, o < t < T, 

[n N (T>] = [g n ] 
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N N N 

Is transformed, by taking F (t) = Q [IT (T-t)], to a standard Riccati matrix 


differential equation 


i- r N (t) + tA N ] T r” ♦ rV] - 

at 


(4.30) - r N tB N ]R _1 [B N ] T r N + [W N ] = 0, 0<t<T 


r N (0) = IG N 1. 


Observe that the self adj ointness of JI^(t) implies [n^(t)]^Q^ = Q^[n^(t)] 
and hence P N (t) T = r N (t). Since B N , W N , G N refer exclusively to the if 1 - 
component of Z^, we have 


[B N ] = col( B Q ,0, • ♦ • ,0) e TFp(2pN+l)xm 


w 0 0 


[w N ] = ? 


■j^i( 2pN+ 1 )xn( 2pN+l ) 


G 0 0 


[G N ] = 


•jgi( 2pN+l )xn( 2pN+l ) 


Thus (if p = 1, = 0) we can reduce the dimension of (4.30) introducing 

the 2nxn(2N+l) matrices 
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*!- 


F o 0 


A I G 0 0 


0 Vl - Vl 


F S - 
2 


I 0 


0 I - I 


where Fg is given by 


F o " A o G o + G o A o - W'^o + W 0 ' 


in order to get the factorization 


r(0) = 


(fJ) T (f!|). 


This implies dig], p. 304 ff.) 


(4.31) 


r N (t) = [G N ] + / L^(s) T L~(s)ds , 
0 


L^(t) being the solution of 


(4.32) 


^L^(t) = L^(t)([A N ] - [B N ]R 1 [B N ] T r N (t ) ) 


lJ(0) - fJ, i « 1,2. 


Multiplying (4.31) from the left with [B^]^ yields 


[B N ] T r N (t) = [bVl^oVJu), 0 < t < T 


(4.33) 


[B N ] T r N (0) - [b n ] t [g n ] . 
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Solving the n(4n+m) (2N+1) differential equations (4.32), (4.33) we get 
[ B N ] T r N ( t ) . But this is all we need for the computation of the suboptimal 

control u (t) (see (3.6)). Denoting the mxn blocks in [B N ] T [JI N (t) ] 
by ^o(t)’*** >^2l/ t )’ we have 

(4.34) u N (t) = -R _1 {6Q(t)x N (t) + 2 f f° e”(t)e^.(s)x N (t+s)ds}, 0 < t < T, 

j=l -h 3 13 ~ ~ 

A N 

where x (t) is the solution of 

(4*35) x(t) = AqX( t) + A^x( t-h) + B 0 u N (t) 

in IFP • In each term of the sum in (4*34), the integration ranges only over 

N 

one of the intervals I ^ , j = 

Numerically the systems (4.34), (4.35) were solved simultaneously by an 
appropriately adjusted 4th order Runge-Kutta procedure combined with Simpson's 
rule for the evaluation of the integrals. 

Example 4.1. Minimize 

2 

J(u) = I (xj (2) 2 + x 2 (2) 2 ) + i / ( Ul (t) 2 + u 2 (t) 2 )dt 

subject to 

^ (t) = (J o) x(t-l) + (J J) u(t), 0<t<2, 

x(0) = x Q (t) = (}) , -1 < t < 0. 
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The true solutions u(t), !c(t) (see [2]) and the piecewise linear approxi- 
mations with index N = 4,8,16 are presented in the Tables 4.1 and 4.2, The 
relatively greatest errors occur around t = 1 and t = 2, where the deriva- 
tives of *x( t ) and u(t) have jumps, while x^(t) and u N (t) are of 

course continuously differentiable. 

For the infinite time horizon control problem (p = 1, A^ = 0) the 
suboptimal control and trajectory are again calculated via (4.34), (4.35) 
when II N (t) is replaced by the stationary operator II N , that is the 
solution of the algebraic Riccati equation (3.7). The transformation 
r N * Q N [n N ] yields a standard Riccati matrix equation 


[A N ] T r N 


+ r N [A N ] - AbW] 


T r N + [w N ] = o 


in u^(2N+l) x n (2N+1)^ which was solved by the Newton-Kleinman-algorithm as 
presented in [18]. In each step of this algorithm, a Ljapunov matrix equation 
was solved using the quadratic procedure given by R. A. Smith (see also [18], 
p. 297). The time independent mxn blocks 8^, j = 0,«**,2N were then 
employed in (4.35). Furthermore, with 


[n N ] = 


N n N 

n oo n n 


t N 
1,2N] 


we give some values of the feedback kernel 


„N, . 
n x (s) 


2N N 

} l t < 3 'll 


N f \ 

e, .(s). 
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t \ 

* 4 

U^(t) 

N 

u^(t) 

u} 6 (t) 

Uj(t) 

0 

-1.0602 

-1.0599 

-1.0598 

-1.0598 

0.25 

-0.8419 

-0.8419 

-0.8419 

-0.8419 

0.5 

-0.6209 

-0.6241 

-0.6239 

-0.6239 

0.75 

-0.4008 

-0.4030 

-0.4060 

-0.4060 

1.0 

-0.2268 

-0.2116 

-0.2022 

-0.1 

880 

1.25 

-0.1743 

-0.1860 

-0.1884 



1.5 

-0.1897 

-0.1878 

-0.1880 



1.75 

-0.1877 

-0.1880 

-0.1880 



2.0 

-0.1880 

-0.1880 

-0.1880 

-0.1 

880 










~ 4 

u 2 (t) 

u®(t) 

u* 6 (t) 

u 2 (t) 

0 

-0.8721 

-0.£ 

1719 

-0.8718 

-0.£ 

1718 

0.25 

-0.8721 







0.5 

-0.8721 







0.75 

-0.8721 

-0.£ 

S719 





1.0 

-0.8720 

-0.£ 

1718 





1.25 

-0.8720 







1.5 

-0.8719 







1.75 

-0.8718 







2.0 

-0.8719 

-0A 

5718 

-0.8718 

-0.8718 

J(u) 

1.4018 

1.4017 

1.4017 

1.4017 


Table 4.1 
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< <*» 

X 1 

t V S s ^^ 

n 

X^(t) 

x®(t) 

A 16,„,. 
x x (t) 

x L (t) 

0.25 

0.76221 

0.76227 

0.76228 

0.76229 

0.5 

0.57927 

0.57902 

0.57905 

0.57906 

0.75 

0.45179 

0.45050 

0.45031 

0.45032 

1.0 

0.37519 

0.37582 

0.37500 

0.37607 

1.25 

0.32780 

0.32910 

0.32905 

0.32906 

1.5 

0.28219 

0.28203 

0.28205 

0.28208 

1.75 

0.23498 

0.23503 

0.23504 

0.23504 

2.0 

0.18799 

0.18802 

0.18803 

0.18803 

t X. 

~ 4 

x 2 (t) 

x®(t) 

*16.,,.,. 
x 2 (t) 

x 2 (t) 

0.25 

1.03198 

1.03203 

1.03205 

1.03205 

0.5 

1.06395 

1.06407 

1.06409 

1.06410 

0.75 

1.09593 

1.09610 

1.09614 

1.09615 

1.0 

1.12791 

1.12814 

1.12818 

1.12821 

1.25 

1.12906 

1.12933 

1.12934 

1.12941 

1.5 

1.07761 

1.07790 

1.07797 

1.07799 

1.75 

0.98737 

0.98748 

0.98755 

0.98758 

2.0 

i 0.87187 

1 

i 

0.87180 

0.87179 

0.87180 


Table 4.2 
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.N 


which together with II QQ determines the feedback law of the Nth approxima- 

tion. At the mesh-points, we simply have 


">) * «n * n l2 • > i * 


Example 4.2. This is the problem of minimizing 


J(u) = / [x(t) 2 + u(t) 2 ]dt 


subject to 


x(t) = x(t) + x(t-l) + u(t), t > 0, 


x(0) = 0, x^(t) = sirnrt, -1 <_ t <_ 0. 


Table 4.3 gives the optimal costs J N = <(x(0) ,x Q ) ,II N (x(0) ,x Q )> 2 of the 

^ N ^ 

approximating systems and the costs J(u ) when the original system is 
controlled by u • 


N 

J N 

J(G N ) 

4 

0.32117 

0.32143 

8 

0.32138 

0.32143 

16 

0.32142 

0.32143 


Table 4.3 
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N. t 

\u 
t \ 

~ A 

u (t) 

; 8 <o 

u (t) 

0. 

0.86968 

0.86836 

0.86818 

0.25 

0.64873 

0.64888 

0.64891 

0.5 

0.49572 

0.49647 

0.49657 

0.75 

0.36350 

0.36395 

0.36400 

1.0 

0.24664 

0.24624 

0.24618 

1.25 

0.16200 

0.16153 

0.16147 

1.5 

0.11027 

0.10997 

0.10993 

1.75 

0.08030 

0.08022 

0.08021 

2.0 

0.06013 

0.06015 

0.06015 ' 

2.25 

0.04349 

0.04347 

0.04347 ! 

2.5 

0.02988 

0.02982 

0.02982 

2.75 

0.02002 

0.01996 

0.01995 ; 

3.0 

0.01377 

0.01373 

0.01372 ! : 

- 1 

' X 

t "x 

' X, 

x^(t) 

x 8 (t) 

" 16 . . 
x (t) j 

0.25 

0.11276 

0.11260 

0.11258 

0.5 

0.05337 

0.05332 

0.05332 

0.75 

- 0.06642 

- 0.06628 

- 0.06626 

1.0 


- 0.10849 

- 0.10846 

1.25 

- 0.06170 

- 0.06160 

- 0.06158 

1.5 

- 0.01396 

- 0.01396 

- 0.01397 

1.75 



0.00752 

2.0 



0.00178 ! 

2.25 




2.5 

- 0.01034 



2.75 




3.0 

- 0.00178 ' 

! 

- 0.00178 

BH 


Table 4.5 
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Example A. 3. A simplified model for a wind tunnel at NASA's Langley Research 
Center is given by (see [4]) 


(4.36) x(t) 


-a 

0 

0 


0 

ka 

0 

0 

0 

1 

x(t) + 

0 

0 

0 

0 

2 

-w 

-2£io 


0 

0 

0 


0 

0 


u(t) , t > 0, 


x(t - 0.33) 


-u 


x(0) - col(-0. 1,8. 547,0) = x Q (t), -0.33 <_ t <_ 0, where k = -0.0117, 
5 » 0.8, u « 6.0, — =■ 1.964. One wants to minimize 


J(u) - / [10 4 x.(t) 2 + u(t) 2 ]dt 

0 


subject to (4.36). 

The true solution of the problem was given in [16]* Note that the 
matrix W Q weighting the contribution of the state trajectory to the costs is 
singular in this example, in contrast to the assumptions in Theorem 3*5. How- 
ever, the piecewise linear approximation scheme produced the following values 
for J(u N ) and J N . 
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N 

,/N, 
J(u ) 

J N 

4 

136.4490 

136“. 1785 

8 

136.4490 

136.2921 

16 

136.4493 

136.3486 

J(u) 

136. 

.4049 


Table 4.6 


N 

o 

o 

t=i 


8677.02161 

-9.81498 

-0.94768 

4 

-9.81498 

0.01850 

0.00186 

— 

-0.94768 

0.00186 

0.00019 


8677.02502 

-9.81503 

-0.94768 

8 

-9.81503 

0.01851 

0.00186 


-0.94768 

0.00186 

0.00019 


8677.02551 

-9.81504 

-0.94768 

16 

-9.81504 

0.01851 

0.00186 


-0.94768 

0.00186 

0.00019 


8677.02405 

-9.81505 

-0.94768 

!=i 

o 

o 

-9.81505 

0.01851 

0.00186 

-0.94768 

0.00186 

0.00019 


Table 

4.7 



In Table 4.7, we compare the first block of the Riccati matrix with the 

^-component of n. The matrices n (t) and n^(t), 
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-h = -0.33 £ t _< 0, have nonzero entries only in their second columns, which 
are shown in Table 4.8 for t = - ^ , j = 0,*»»,4. 


j 

0 

1 

2 

3 

4 


-41.39647 

-43.83755 

-46.36726 

-48.97855 

-51.67634 


0.06915 

0.06653 

0.06358 

0.06095 

0.05845 


0.00669 

0.00641 

0.00614 

0.00589 

0.00564 


-41.39710 

-43.84694 

-46.37700 

-48.98892 

-51.68730 

I?C- £> 

0.06917 

0.06633 

0.06359 

0.06097 

0.05847 


0.00668 

0.00640 

0.00614 

0.00589 

0.00565 


-41.39721 

-43.84929 

-46.37952 

-48.99157 

-51.69010 

"I 6 (- JS) 

0.06917 

0.06631 

0.06360 

0.06098 

0.05847 

1 

0.00668 

0.00640 

0.00614 

0.00589 

0.00565 


-41.39721 

-43.85008 

-46.38034 

-48.99246 

-51.69103 

V- 

0.06917 ; 

0.06632 

0.06360 

0.06098 

0.05847 

i 

0.00668 

0.00641 

0.00614 

0.00589 

0.00565 


Table 4.8 
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